Comparing Free Hand Menu Techniques for Distant Displays using Linear, Marking and Finger-Count Menus

Part 1: Long and Short PapersInternational audienceDistant displays such as interactive Public Displays (IPD) or Interactive Television (ITV) require new interaction techniques as traditional input devices may be limited or missing in these contexts. Free hand interaction, as sensed with computer vision techniques, presents a promising interaction technique. This paper presents the adaptation of three menu techniques for free hand interaction: Linear menu, Marking menu and Finger-Count menu. The first study based on a Wizard-of-OZ protocol focuses on Finger-Counting postures in front of interactive television and public displays. It reveals that participants do choose the most efficient gestures neither before nor after the experiment. Results are used to develop a Finger-Count recognizer. The second experiment shows that all techniques achieve satisfactory accuracy. It also shows that Finger-Count requires more mental demand than other techniques.</p

Marker-Based Embodied Interaction for Handheld Augmented Reality Games

Abstract This paper proposes embodied and manipulative interaction for handheld augmented reality games. We use camera-equipped mobile devices and marker-based interaction as a means for gesture-based control of games that incorporate physical and virtual aspects. In addition to being a controller that recognizes multiple game-dependent gestures, the mobile device displays the camera image and augments it with graphical overlays. The overlays are registered with objects and areas in the camera image. We have developed marker-based interaction techniques that capture the posture and movement of a device relative to a marker and thus enable manipulative control. We describe game prototypes that use ubiquitous product packaging and other passive media as backgrounds for handheld augmented reality games.